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ABSTRACT 



While scnool systems moet often use achievement test 
results for individual appraisals, increasing attention to prograjn 
evaluation and accountability requires that test results be used for 
institutional appraisala as well. When institutional test results are 
desired-=that is, results for schools or school districts— not all 
pupils need be tested. Two alternative testing program designs are 
proposed, for situations where individual test reaulta are desired 
for some subject areas or grades, and institutional results are 
desired for othe^rs. Seventeen alternative finite-population sampling 
procedures can be used with these designs. The efficiency of each 
procedure is evaluated using data. from a medium-sized school 
district, and relative efficiencies are derived. Some uampling 
procedures are found to yield acceptable precision for estimation of 
district-mean achievement with a sampling fraction of only five 
percent, (Author) ^ 
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Table li Sampling procedures thot can be used only with a contplementary 
testing program where all pupils are tasted in some subjects 
and Bampled pupils are tested In ather subjects (Plan I), 



1) Stratified sampling of pupils with proportional alloaatlon 
of sample glges to strata 

2) Stratified sampling of pupils with optimal allocation of 
sample slaes to strata 

3) Linear systeTnatlc sampling of pupils from a list arranged 
in increasing order of an auKiliary variable 

4) Linear systematic sampling ©f pupils from a list arranged 
in increasing order of an auKlliary variable , with use of 
end corrections in estimation 

5) Linear systematic sampling of pupils from a list arranged 
in increasing order of an auKillary variable ^ then with 
order reversed In alternate strata 

6) Centrally located systematic sampling 

7) Balanced systematic sampling 

8) Simple random sampling of classrooms Cslngle stage 
cluster sampling), with ratio- estimation 

9) Single stage cluster sampling of classrooms where class- 
rooms are selected with probabilities proportional to 
the values of a classroom-related auxiliary variable, 
and PPES estimation 
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Table 2f Sampling procedur'2B tVat can be used either with a compla- 
mentary testing program t?here all pupils are tested in some 
iubjects and some pupils are tasted In others (Plan I) ^ or 
with a plan whera all pupils are tested 'in lome grades and 
some pupils are tested in ethers (Plan II). 



1) Simple random sampling of pupils 

2) Linear systematic sapling of pupils from a list arranged 
In alphabetic order 

3) Slitiple random sampling of ichools (single stage cluster 
sainpling) ^ with unbiased estimation 

4) Slinpla random sampling of schools (single state cluster 
sampling) vith ratio estimation 

5) Single stage cluster sampling of schools where schools 
are seleeted with probabilities proportional to their 
enrollments (PPS sampling) and PPS estimation 

6) Single stage cluster sampling of schools where schools 
are selected with probabilities proportional to the 
values of a school-related auKillary variable, and 
PPES estimation 

7) Simple random sampling of classrooms (single stage 
cluster sampling) 5 with unbiased estimation 

8) Single stage cluster eampllng of classrooms where 
classroums are selected with probabilities proportional 
to their enroilmants (PPS sampling) and PPS estimation 



Table 3i Sizes of Samples Required to Estimate Mean Raadlng Achievement 
within + 0.2 Grade Equivalent Units with 95 Percent Confidence 



SaFpllnp and FstiF.a tln n '^rocQduro 
Simple Random Sampling (SRS) 

Stratified Sampling by Lorga-Thorndike 
Ability Test Scores - Six Strata: 

Proportional Allocation (Strat-prop) 
Optimal Allocation (Strat-opt) 
Linear Systematic Sampling i 

Alphabetic Order (LSS-alpha) ^ 

Increasing Order of Lorge-Thorndlke 
Scores . (LSS-inc) < 

Increasing Order of of Lorge-Thorndlke 
Scores; End Corrections Used (LSS — E,C.) < 

Order Reversed in Alternate . Strata (LSS-0,R) < 
Centrally Located Systematic Samples (CSS) < 
Balanced Systematic Sampling (BSS) 
Single Stage Cluster Sampling? 

Unbiased Estimation^ Schools Used as 
Clusters (RSC-schools-unb) 

Ratio Estimation, Schools Used as 
Clusters (RSC-achools-rat) 

Probabilitiei Proportional to School 
Enrollments, Schools Used as 
Clusters (PPS-schools) 

Probabilities Proportional to Fifth-Grade 
SCAT Score Totals, Schools Used as 
Clusters (PPES-achools) 

i 

Unbiased Estimation, Classrooms Used 
as Clusters CRSC--class-unb) 

Ratio Estimation^ Classrooms Used as 
Clusters (RSC-class-rat) 

Probabilities Proportional to Classroom 
Enrollments, Classrooms Used as Clusters 
(PPS-cla.qs) 

Probabillt lea Proportional to Lorge-Thorndike 
Score Totals^ Classrooms Used as Clusters 
CPPES-class) 



Required Sample SiEg 
106 pupils 



26 pupils 
25 pupils 

59 pupils*>^ 
59 pupils^* 

59 pupils^^ 

59 pupils^^ 
1 59 puplls^^ 
lis pupils 

1041 pupils 
394 pupils 

577 pupils 

236 pupils 
865 pupils 

262 pupils 
314 pupils 
53 pupils 
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^Mldcity data, population size - 1180 si3£th-grade pupils. 

**F±ye percent is the smallest sapling fract ion Investigate^ sampling 
fractions might provide acceptable precision for these sampling methods. 



Table 4i Sampling Fractions Requirtd for Estimation of Proportion of 

Low-Achlevln^^ Pupils* for Various Sampling and Estimation Procedures, 



Raquirad Sampling Fractions 
For Estimation For Estltnatlon 

within +0.02 within +0*05 

Sampling and EstimatlQn Procedure at 95% Confidence at 95% Confldenc 



Sln^pla Random Sampling (SRS) 60% 20% 

Linear Systematic Sampling? 

Population in Alphabetic 

Order CLSS^^^alpha) 25% 20% 

Population in Increasing 
Order of Loree-Thorndike 

Test Scores (LSS-lnc) 25% 10%^ 

Population in Increasing 
Order of Lorge-Thorndike 
Tast ScoreSi, End Corrections 

Used (LSS-^E.C:/) 25% 10% 

Population in Increasing 
Order of Lerga-Thorndika 
Scorass Order Reveraed in 

Alternate Strata (LSS-O.K.) 25% 10% 

Balanced Syetamatic Samplings 
Population in IncrEaalng Order 

of Lorga-Thorndike Scores (BSS) 251 10% 

Centrally Located Systaltic Samples^ 

Population in Increasing Order of ' 
Lorge*Thorndlke Test ScoreB (CSS) 25% 10% 



^Proportion of 1180 sixth-grade pupUe in Mideity with reading achievement 
scorea at least one grade equl\^alent unit below natlgnal norm. 



